Intra- and inter-operator reproducibility of automated cloud-based carotid lumen diameter ultrasound measurement

Background: Common carotid artery lumen diameter (LD) ultrasound measurement systems are either manual or semi-automated and lack reproducibility and variability studies. This pilot study presents an automated and cloud-based LD measurements software system (AtheroCloud) and evaluates its: (i) intra/inter-operator reproducibility and (ii) intra/inter-observer variability. Methods: 100 patients (83 M, mean age: 68 ± 11 years), IRB approved, consisted of L/R CCA artery (200 ultrasound images), acquired using a 7.5-MHz linear transducer. The intra/inter-operator reproducibility was verified using three operator's readings. Near-wall and far carotid wall borders were manually traced by two observers for intra/inter-observer variability analysis. Results: The mean coefficient of correlation (CC) for intra- and inter-operator reproducibility between all the three automated reading pairs were: 0.99 (P < 0.0001) and 0.97 (P < 0.0001), respectively. The mean CC for intra- and inter-observer variability between both the manual reading pairs were 0.98 (P < 0.0001) and 0.98 (P < 0.0001), respectively. The Figure-of-Merit between the mean of the three automated readings against the four manuals were 98.32%, 99.50%, 98.94% and 98.49%, respectively. Conclusions: The AtheroCloud LD measurement system showed high intra/inter-operator reproducibility hence can be adapted for vascular screening mode or pharmaceutical clinical trial mode

A low-cost machine learning-based cardiovascular/stroke risk assessment system: integration of conventional factors with image phenotypes

Background: Most cardiovascular (CV)/stroke risk calculators using the integration of carotid ultrasound image-based phenotypes (CUSIP) with conventional risk factors (CRF) have shown improved risk stratification compared with either method. However such approaches have not yet leveraged the potential of machine learning (ML). Most intelligent ML strategies use follow-ups for the endpoints but are costly and time-intensive. We introduce an integrated ML system using stenosis as an endpoint for training and determine whether such a system can lead to superior performance compared with the conventional ML system.Methods: The ML-based algorithm consists of an offline and online system. The offline system extracts 47 features which comprised of 13 CRF and 34 CUSIP. Principal component analysis (PCA) was used to select the most significant features. These offline features were then trained using the event-equivalent gold standard (consisting of percentage stenosis) using a random forest (RF) classifier framework to generate training coefficients. The online system then transforms the PCA-based test features using offline trained coefficients to predict the risk labels on test subjects. The above ML system determines the area under the curve (AUC) using a 10-fold cross-validation paradigm. The above system so-called "AtheroRisk-Integrated" was compared against "AtheroRisk-Conventional", where only 13 CRF were considered in a feature set.Results: Left and right common carotid arteries of 202 Japanese patients (Toho University, Japan) were retrospectively examined to obtain 395 ultrasound scans. AtheroRisk-Integrated system [AUC=0.80, P<0.0001, 95% confidence interval (CI): 0.77 to 0.84] showed an improvement of similar to 18% against AtheroRisk-Conventional ML (AUC=0.68, P<0.0001, 95% CI: 0.64 to 0.72).Conclusions: ML-based integrated model with the event-equivalent gold standard as percentage stenosis is powerful and offers low cost and high performance CV/stroke risk assessment

Integration of cardiovascular risk assessment with COVID-19 using artificial intelligence

Artificial Intelligence (AI), in general, refers to the machines (or computers) that mimic "cognitive" functions that we associate with our mind, such as "learning" and "solving problem". New biomarkers derived from medical imaging are being discovered and are then fused with non-imaging biomarkers (such as office, laboratory, physiological, genetic, epidemiological, and clinical-based biomarkers) in a big data framework, to develop AI systems. These systems can support risk prediction and monitoring. This perspective narrative shows the powerful methods of AI for tracking cardiovascular risks. We conclude that AI could potentially become an integral part of the COVID-19 disease management system. Countries, large and small, should join hands with the WHO in building biobanks for scientists around the world to build AI-based platforms for tracking the cardiovascular risk assessment during COVID-19 times and long-term follow-up of the survivors

Carotid artery stenosis and brain connectivity: the role of white matter hyperintensities

Purpose It is under debate how white matter hyperintensities (WMH) affects the brain connectivity. The objective of this research study is to validate the hypothesis, if and how the WMH influences brain connectivity in a population with carotid artery stenosis (CAS), which are eligible for carotid endarterectomy (CEA). We used resting state functional connectivity (rs-fc) magnetic resonance (MR) to validate our hypothesis, focusing on the effects of the total number of WMH (TNWMH) and of the WMH Burden (WMHB). Methods Twenty-three patients (sixteen males and seven females, mean age 74.34 years) with mono or bilateral carotid stenosis eligible for carotid endarterectomy (CEA), underwent an MR examination on a 1.5-T scanner. The protocol included a morphologic T1-3D isotropic, an EPI functional sequence for rs-fc MR analysis, and a 3D isotropic FLAIR sequence. For each patient, the TNWMH and the WMHB were obtained using two online tools-volBrain and lesionBrain. The rs-fc region-of-interest to region-of-interest (ROI-to-ROI) analysis was performed with the CONN toolbox v18a: two different multiple regression analyses including both WMHB and TNWMH as second-level covariates evaluated the individual effects of WMHB (Analysis A) and TNWMH (Analysis B), adopting a p value corrected for false discovery rate (p-FDR) < 0.05 to identify statistically significant values. Results Both analyses A and B identified several statistically significant positive and negative correlations associated with WMHB and TNWMH. Conclusion WMH influence functional connectivity in patients with carotid artery stenosis eligible for CEA; further, WMHB and TNWMH influence differently functional connectivity

Symtosis: A liver ultrasound tissue characterization and risk stratification in optimized deep learning paradigm

Background and Objective Fatty Liver Disease (FLD) - a disease caused by deposition of fat in liver cells, is predecessor to terminal diseases such as liver cancer. The machine learning (ML) techniques applied for FLD detection and risk stratification using ultrasound (US) have limitations in computing tissue characterization features, thereby limiting the accuracy. Methods Under the class of Symtosis for FLD detection and risk stratification, this study presents a Deep Learning (DL)-based paradigm that computes nearly seven million weights per image when passed through a 22 layered neural network during the cross-validation (training and testing) paradigm. The DL architecture consists of cascaded layers of operations such as: convolution, pooling, rectified linear unit, dropout and a special block called inception model that provides speed and efficiency. All data analysis is performed in optimized tissue region, obtained by removing background information. We benchmark the DL system against the conventional ML protocols: support vector machine (SVM) and extreme learning machine (ELM). Results The liver US data consists of 63 patients (27 normal/36 abnormal). Using the K10 cross-validation protocol (90% training and 10% testing), the detection and risk stratification accuracies are: 82%, 92% and 100% for SVM, ELM and DL systems, respectively. The corresponding area under the curve is: 0.79, 0.92 and 1.0, respectively. We further validate our DL system using two class biometric facial data that yields an accuracy of 99%. Conclusion DL system shows a superior performance for liver detection and risk stratification compared to conventional machine learning systems: SVM and ELM

Extreme learning machine framework for risk stratification of fatty liver disease using ultrasound tissue characterization

Fatty Liver Disease (FLD) is caused by the deposition of fat in liver cells and leads to deadly diseases such as liver cancer. Several FLD detection and characterization systems using machine learning (ML) based on Support Vector Machines (SVM) have been applied. These ML systems utilize large number of ultrasonic grayscale features, pooling strategy for selecting the best features and several combinations of training/testing. As result, they are computationally intensive, slow and do not guarantee high performance due to mismatch between grayscale features and classifier type. This study proposes a reliable and fast Extreme Learning Machine (ELM)-based tissue characterization system (a class of Symtosis) for risk stratification of ultrasound liver images. ELM is used to train single layer feed forward neural network (SLFFNN). The input-to-hidden layer weights are randomly generated reducing computational cost. The only weights to be trained are hidden-to-output layer which is done in a single pass (without any iteration) making ELM faster than conventional ML methods. Adapting four types of K-fold cross-validation (K = 2, 3, 5 and 10) protocols on three kinds of data sizes: S0-original, S4-four splits, S8-sixty four splits (a total of 12 cases) and 46 types of grayscale features, we stratify the FLD US images using ELM and benchmark against SVM. Using the US liver database of 63 patients (27 normal/36 abnormal), our results demonstrate superior performance of ELM compared to SVM, for all cross-validation protocols (K2, K3, K5 and K10) and all types of US data sets (S0, S4, and S8) in terms of sensitivity, specificity, accuracy and area under the curve (AUC). Using the K10 cross-validation protocol on S8 data set, ELM showed an accuracy of 96.75% compared to 89.01% for SVM, and correspondingly, the AUC: 0.97 and 0.91, respectively. Further experiments also showed the mean reliability of 99% for ELM classifier, along with the mean speed improvement of 40% using ELM against SVM. We validated the symtosis system using two class biometric facial public data demonstrating an accuracy of 100%

Lung disease stratification using amalgamation of Riesz and Gabor transforms in machine learning framework

Lung disease risk stratification is important for both diagnosis and treatment planning, particularly in biopsies and radiation therapy. Manual lung disease risk stratification is challenging because of: (a) large lung data sizes, (b) inter- and intra-observer variability of the lung delineation and (c) lack of feature amalgamation during machine learning paradigm. This paper presents a two stage CADx cascaded system consisting of: (a) semi-automated lung delineation subsystem (LDS) for lung region extraction in CT slices followed by (b) morphology-based lung tissue characterization, thereby addressing the above shortcomings. LDS primarily uses entropy-based region extraction while ML-based lung characterization is mainly based on an amalgamation of directional transforms such as Riesz and Gabor along with texture-based features comprising of 100 greyscale features using the K-fold cross-validation protocol (K = 2, 3, 5 and 10). The lung database consisted of 96 patients: 15 normal and 81 diseased. We use five high resolution Computed Tomography (HRCT) levels representing different anatomy landmarks where disease is commonly seen. We demonstrate the amalgamated ML stratification accuracy of 99.53%, an increase of 2% against the conventional non-amalgamation ML system that uses alone Riesz-based feature embedded with feature selection based on feature strength. The robustness of the system was determined based on the reliability and stability that showed a reliability index of 0.99 and the deviation in risk stratification accuracies less than 5%. Our CADx system shows 10% better performance when compared against the mean of five other prominent studies available in the current literature covering over one decade

Plaque tissue morphology-based stroke risk stratification using carotid ultrasound: a polling-based PCA learning paradigm

Severe atherosclerosis disease in carotid arteries causes stenosis which in turn leads to stroke. Machine learning systems have been previously developed for plaque wall risk assessment using morphology-based characterization. The fundamental assumption in such systems is the extraction of the grayscale features of the plaque region. Even though these systems have the ability to perform risk stratification, they lack the ability to achieve higher performance due their inability to select and retain dominant features. This paper introduces a polling-based principal component analysis (PCA) strategy embedded in the machine learning framework to select and retain dominant features, resulting in superior performance. This leads to more stability and reliability. The automated system uses offline image data along with the ground truth labels to generate the parameters, which are then used to transform the online grayscale features to predict the risk of stroke. A set of sixteen grayscale plaque features is computed. Utilizing the cross-validation protocol (K = 10), and the PCA cutoff of 0.995, the machine learning system is able to achieve an accuracy of 98.55 and 98.83%corresponding to the carotidfar wall and near wall plaques, respectively. The corresponding reliability of the system was 94.56 and 95.63%, respectively. The automated system was validated against the manual risk assessment system and the precision of merit for same cross-validation settings and PCA cutoffs are 98.28 and 93.92%for the far and the near wall, respectively.PCA-embedded morphology-based plaque characterization shows a powerful strategy for risk assessment and can be adapted in clinical settings

Accurate cloud-based smart IMT measurement, its validation and stroke risk stratification in carotid ultrasound: A web-based point-of-care tool for multicenter clinical trial

This study presents AtheroCloud™ - a novel cloud-based smart carotid intima-media thickness (cIMT) measurement tool using B-mode ultrasound for stroke/cardiovascular risk assessment and its stratification. This is an anytime-anywhere clinical tool for routine screening and multi-center clinical trials. In this pilot study, the physician can upload ultrasound scans in one of the following formats (DICOM, JPEG, BMP, PNG, GIF or TIFF) directly into the proprietary cloud of AtheroPoint from the local server of the physician's office. They can then run the intelligent and automated AtheroCloud™ cIMT measurements in point-of-care settings in less than five seconds per image, while saving the vascular reports in the cloud. We statistically benchmark AtheroCloud™ cIMT readings against sonographer (a registered vascular technologist) readings and manual measurements derived from the tracings of the radiologist.One hundred patients (75 M/25 F, mean age: 68±11 years), IRB approved, Toho University, Japan, consisted of Left/Right common carotid artery (CCA) artery (200 ultrasound scans), (Toshiba, Tokyo, Japan) were collected using a 7.5 MHz transducer. The measured cIMTs for L/R carotid were as follows (in mm): (i) AtheroCloud™ (0.87±0.20, 0.77±0.20); (ii) sonographer (0.97±0.26, 0.89±0.29) and (iii) manual (0.90±0.20, 0.79±0.20), respectively. The coefficient of correlation (CC) between sonographer and manual for L/R cIMT was 0.74 (P<0.0001) and 0.65 (P<0.0001), while, between AtheroCloud™ and manual was 0.96 (P<0.0001) and 0.97 (P<0.0001), respectively. We observed that 91.15% of the population in AtheroCloud™ had a mean cIMT error less than 0.11 mm compared to sonographer's 68.31%. The area under curve for receiving operating characteristics was 0.99 for AtheroCloud™ against 0.81 for sonographer. Our Framingham Risk Score stratified the population into three bins as follows: 39% in low-risk, 70.66% in medium-risk and 10.66% in high-risk bins. Statistical tests were performed to demonstrate consistency, reliability and accuracy of the results. The proposed AtheroCloud™ system is completely reliable, automated, fast (3-5 seconds depending upon the image size having an internet speed of 180 Mbps), accurate, and an intelligent, web-based clinical tool for multi-center clinical trials and routine telemedicine clinical care